Boosting LLM accuracy with Entity Resolution-based RAG

Hendrik Nehnes • Location: TUECHTIG • Back to Haystack EU 2024

Enterprises are increasingly looking to run Large Language Models (LLMs) on private, internal data that LLMs have never seen and which must remain confidential. Retrieval Augmented Generation (RAG) enhances LLMs with data from specific, controlled sources. Typically, RAG uses vector databases, which excel at retrieving information from unstructured data. However, for structured data like customer records, a different RAG approach may be better. In this talk, we introduce Entity RAG, which uses real-time entity resolution to provide LLMs with accurate, unified data about real-world entities such as customers, companies, and products. We will showcase a use case integrated with Langchain, demonstrating the benefits of using entity resolution technology alongside vector databases. You will learn how to quickly set up an entity resolution system to deliver fast, accurate entity data to your LLM.

Download the Slides Watch the Video

Hendrik Nehnes

Tilores

Hendrik is co-founder and CPO of Tilores, the API for unifying scattered customer data in real-time. An experienced tech leader used to dealing with big data infrastructure, he was previously the Group IT Director at the affiliate network giant Awin. At Regis24, where Tilores' entity resolution technology was originally conceived, he was the CTO, where he led the company's transition into cloud and serverless technology.